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Non-equilibrium steady states (NESS) of Markov processes give rise to non-trivial cyclic proba- 
bility fluxes. Cycle decompositions of the steady state offer an effective description of such fluxes. 
Here, we present an iterative cycle decomposition exhibiting a natural dynamics on the space of 
cycles that satisfies detailed balance. Expectation values of observables can be expressed as cycle 
"averages", resembling the cycle representation of expectation values in dynamical systems. We 
illustrate our approach in terms of an analogy to a simple model of mass transit dynamics. Sym- 
metries are reflected in our approach by a reduction of the minimal number of cycles needed in the 
decomposition. These features are demonstrated by discussing a variant of an asymmetric exclusion 
process (TASEP). Intriguingly, a continuous change of dominant flow paths in the network results 
in a change of the structure of cycles as well as in discontinuous jumps in cycle weights. 
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I. INTRODUCTION 

A major challenge of statistical physics is to iden- 
tify principles organizing the structure of steady states 
[T]. Equilibrium systems are singled out by detailed bal- 
ance, a symmetry in the transition rates between differ- 
ent states that explicitly yields the systems' free energies 
[H 13] and thereby all its linear thermodynamic proper- 
ties. In non-equilibrium steady states (NESS), detailed 
balance is broken and non-trivial currents can be identi- 
fied. 

Following Penrose [4] , we idealize observable processes 
as irreducible Markov processes on a finite state space. 
Here, irreducible means that the system can reach any 
state i from any other state j with a finite number of 
transitions. On a finite state space this implies ergodicity 
and hence ensures the existence of a steady state ,5;. 

Conservation of probability in the form of KirchhofF's 
law induces probability flux cycles [H IS [MTT] , and there 
are a number of distinct ways to decompose the station- 
ary dynamics as cycles: Schnakenberg network theory 
(SNT, 0) and subsequent work (see eg. [SIHj) is based 
on identifying a fundamental set of cycles after identify- 
ing a spanning tree. A recent approach further gener- 
alizes those results to a different basis of oriented cycles 
[S] . From a more mathematical point of view, Kalpazidou 
[7] and the Beijing school of Quians [TU] independently 
developed a rigorous formalism to describe Markov pro- 
cesses on finite (and countably infinite) state spaces using 
cycles. They distinguish between stochastic and deter- 
ministic decomposition algorithms. The former leads to 
the cycle decompositions used by Hill ^Uj and has an ef- 
fective dual description as a Markov process on the set 
of all possible cycles. It also has the benefit that a cycle 
can be interpreted as the so-called completion rate of this 
cycle within the stochastic dynamics (Ulini- The latter, 
deterministic approach is closely related to the algorithm 



used in the present work. It is complementary to both 
SNT and Hill's cycles. 

Here, we present a method to map NESS fluxes onto a 
Markov process on a dual space of flux cycles. Detailed 
balance is restored in that description, which allows to 
define a potential function as in the case of equilibrium 
systems. Steady-state averages take the form of equilib- 
rium averages on the dual space. 

The essence of our approach is best viewed in the en- 
semble picture. Consider a large number of identical 
physical systems with a finite number of states. Each 
system entering a certain state i stays there for an av- 
erage time (r^), and then proceeds to another state j 
according to a fixed transition rate. Up to normalization 
the flux may be seen as the number of systems proceed- 
ing from one state to another per unit time. In figure [l] 
we present an elementary six-state example motivated by 
the TASEP example discussed below (c/. figure|3]and ta- 
bles IpTT). The cycle representation of the fluxes means 
to write them as a linear superposition of cycle fluxes 
with a non-negative weight assigned to each cycle. Such 
representations exist for any NESS Ej ■ 

The aim of this work is to explore consequences of this 
point of view on NESS, with emphasis on the relation of 
cycles and non-equilibrium phase-transitions. 

The paper is organized as follows. In sections [llf|I V| we 
introduce cycles as a topological backbone of NESS. In 
section|V]we compare the present approach to other phys- 
ical cycle theories, [21 [H]. We see that a natural stochas- 
tic dynamics leads to detailed balance on the dual space 



of cycles in section VI Section |VII| defLnes Boltzmann-like 
averages on cycle space. They are related to physical cur- 
rent variables in section |VIII[ Finally, in section |IX| we 
use a TASEP as an example to investigate how phase- 
transitions and symmetries influence the cycle structure. 
Appendix |A] describes useful thermodynamic and electric 
analogies which also remain valid in the discrete 
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explained in appendix [B] 



II. MARKOV PROCESSES REVISITED 

We start by briefly reviewing Markov processes on a 
finite state space O [31 [S] . To better follow the line of 
arguments, it is helpful to consider a socio-physical anal- 
ogy: the cycles may be interpreted as the lines of a mass 
transit system with the peculiarity that the lines are run- 
ning one-way on closed loops. The fluxes are proportional 
to the total amount of passengers traveling from one sta- 
tion to another; i.e., from a state i to a state j of the 
Markov process. The lines are represented in different 
colors in figure [l] We imagine each passenger to carry a 
(correspondingly colored) ticket indicating the line he is 
currently using. Passengers can change lines in the sta- 
tions. To remain in a steady state this involves a random 
exchange of tickets between passengers at stations. 

We represent the process as a random walk on a graph 
G = (y,E) with N = \V\ vertices v,, i € {l,...,iV} 
and directed edges € E. The vertices represent the 
states of the system, and are shown as gray circles dis- 
playing the vertex indices 1, . . . , 6 in figure [T] A system 
entering vertex Vi will jump to another vertex Vj with 
probability a* after having stayed in state i for an ex- 
ponentially distributed waiting time r^. Consequently, 
the (time-independent) transition rates per unit time are 
w'j := aj/{Ti). A system trajectory is the realization of a 
random walk of one of the passengers through the transit 
system. In terms of the transition matrix 



w;:= 



or for the fiuxcs from i to j ^ i 

4>){t) ^ p,{t)w) 



for i ^ j 
for i = j 



(1) 



(2) 



the equation for the evolution of the probability pi (t) to 
find the system in a state i at time t takes the compact 
form 



dt 



(3) 



Here and in the following we suppress the explicit time- 
dependence and write, e.g., pi instead of Pi{t). The first 
equality in ([s]) stresses the linearity of the problem and 
is useful for algebraic considerations. The second em- 
phasizes the physical concept of a master or continuity 
equation: in a steady state the net influx must equal 
the net outflux, = Vi ■ In terms of the 

currents, P, := cf)! — d)'' , this node condition, 



amounts to Kirchhoff 's current law which expresses parti- 
cle (or probability) conservation at each vertex . Here 
and in the following the * marks steady-state quantities. 

Due to the continuity equation ^ every normalized 
initial distribution remains normalized at all times, and 
it relaxes to a steady state p* jSj . 

Algebraically the steady-state probability distribution 
p* is a left eigenvector of W with eigenvalue zero. Er- 
godicity ascertains the existence of a path iq . . .in with a 
positive := Y[j=i ^\]^^ every pair of vertices 

if) and i„. This ensures existence and uniqueness of the 
normalized distribution obeying 



(5) 



In the physics literature a steady state is called an equi- 
librium if it obeys detailed balance^ i.e., if the individual 
fluxes between any two vertices i and j cancel, i.e.. 



0. 



(6) 



Detailed balance further implies a weaker symmetry 
that is sometimes called dynamical reversibility |13j . It 
means that if a transition is allowed, so is its reverse, i. e. , 



J 



> 0. 



(7) 



The cycle decomposition does not need this symmetry in 
the transition rates, i.e., we allow for unidirectional tran- 
sitions. Consequences of dynamically reversible systems 
are discussed below. 

For an equilibrium system the ratio of uJig^,,,^i^ and 
the one for the reverse path a;i^....,io only depends on 
the initial and final point irrespective of the chosen path 

[3] . Examining the above relation for paths starting 
from a fixed reference vertex j one obtains an explicit 
representation of the steady-state probability density 



=Pi 



(i) 

Then one can always write f7j = Ui + Cj, where Ui is a 
universal function and Cj depends on the chosen reference 
site. Consequently, 



(8) 



where the partition function 

Z = ^exp(-C/,) 

k 

secures normalization, ([s]). 



(9a) 



(9b) 



III. CYCLE REPRESENTATION AND 
TRANSFORM 



= 



= E^^ 



(4) The cycle transform is based on the idea that fluxes 

in a steady state may be represented as superpositions 





3(«i + 1 < + 2 < /3 
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+ 2 




FIG. 1. Representation of a NESS in terms of linear superpositions of cycle fluxes. The numbers on the arrows (representing 
the directed transitions) are the values of the fluxes. The steady-state fluxes between the states - ® can be decomposed 
into cycle fluxes (labeled by Greek letters) with positive weights. Two different decompositions are possible. 



of cycle fluxes (cf . figure [T]) . A cycle a of length Sq is 
an equivalence class of ordered sets of Sa vertices which 
form a self-avoiding closed path, where paths differing 
only by a cyclic permutation of vertices are identified. 
We quantify the number of systems traversing each edge 
of a by the weight m* . There can be several cycles along 
an edge (i, j) and the flux quantifies the total number 
of systems traversing that edge per unit time, fn the 
remainder of this section we work out how the steady- 
state fluxes can be represented by different cycles a with 
positive weights m* assigned to each of them. 

To express the geometrical structure of the cycles we 
define the indicator (or passage) functions Xj a ^-nd Xi,a 
as 



1 if a passes through the directed edge {i, 

otherwise 

1 if a passes through vertex i 
otherwise 



Oa) 



(10b) 



(/>^ that contains the steady-state fluxes of the original 
system: 



• Initialization: 



(/.f ^ :=0f , foralH,j. 



(13) 



Successively subtract the fluxes along different cycles. In 
the fcth step set m* ^ to be the minimum of the values of 

the flux (pj along the edges contained in a^. The new 
flux field in iteration fc -f 1 is the current one with m* 
subtracted at the edges traversed by cycle ak- 



Oik 



• Iteration: 



TO* := min{0' 



(14a) 
(14b) 



In the language of graph theory x] a the adjacency 
matrix of a cycle. The following identities hold: 



^ y Xj.a ^ ^ Xj.a Xi,on 
3 3 

^ ^ Xi,a — J 



(11a) 
(lib) 



where Sa is the length of the cycle a. With their help 
we formulate the ideas of the previous paragraph mathe- 
matically. As we show below, there is a set of cycles {a^} 
with non-negative flux densities to* > such that 



E 



""^aXj^a 



(12) 



for all pairs of vertices («, j). 

To obtain a decomposition we choose an arbitrary enu- 
meration of all M possible cycles ai, a2, ■ ■ ■ , ctM on G. 
The ambiguity in choosing the order of this enumeration 
leads to different decompositions constructed by the fol- 
lowing algorithm: 

Start the iteration for cycle ai with a flux field 



The algorithm terminates after all possible cycles have 
been considered: 

• Termination condition: 



k = M 



(15) 



We show below that at this point all edge fluxes have 
been assigned to a cycle, and the remaining flux field is 
zero along all edges. 



IV. 



EXISTENCE OF A VALID 
DECOMPOSITION 



(16) 



The algorithm and its proof were first mentioned by 
MacQueen [13] and later by Kalpazidou We briefly 
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review their argument. To show existence of the decom- 
position we demonstrate that for every flux field satis- 
fying the steady-state condition, Q, the algorithm ter- 
minates with zero fluxes along all edges, (16), and pro- 



vides non-negative weights which fulfill the defining equa- 
tion ( 12 ). The algorithm always terminates in finite time 



becau se M is finite. Since the weight assigned to a cycle, 

I . (fc) 

( 14a I, is the minimum of all among the edges of cy- 



cle afe, the new fluxes 



assigned by ( 14b I remain 



non-negative. Consequently, the steady-state weights 



TO, 



are non-negative. 



flux 0* ^ 0. If this flux fulfills the node condition 
there is a cycle which could have been assigned a larger 
weight TO*^, contradicting (14a). Hence, the remaining 
fluxes obey 



We prove ( 16 ) by contradiction. Suppose there is a 



E 



^0. 



(17) 



In contrast, for every steady state the initial flux field 
( jls] ) fulfills the node condition ([4|. Iterating the initial 
flux field we find 







E 

i 

E(^} 

3 

E(^ 



(fe+i) 



{k+i) 



dk+i) 



(18) 



where we used (11a) in the last line. In contradiction to 



(17) this holds for every k < AI, proving (16) 



By construction the cycle fluxes obtained in this way 
fulfill (12). We use (14b) and a telescope sum argument 



to obtain 



M 

E 

k=l 



where in the last equation we used the algorithm initial- 
ization ( 13 ) and ( 16 ) . 



V. NUMBER OF CYCLES 

Kalpazidou pointed out '15] that the maximal number 
of cycles needed is the Betti number Mb = \E\ — N + 1 
used in algebraic topology. This can also be seen di- 
rectly from the algorithm. After all, in a worst-case sce- 
nario each non-trivial cycle reduces the flux along one 
edge. Because the iterated flux-field always fulfills the 
node condition (|4| the number of remaining edges at any 
vertex can never be exactly one. Then, as the graph is 
connected, at some point in the algorithm, \E\ — N non- 
trivial weights TO* have been assigned and the remaining 



flux field consists of N nodes forming a cycle which will 
be assigned the last non-trivial weight. 

A minimal number of cycles with non-vanishing 
weights cannot be stated in general. However, symme- 
tries present in the system that lead to the same fluxes at 
many edges may decrease this number as in the example 
below. 

The Betti number Mb can also be related to the num- 
ber of cycles used in SNT [2]. In the latter theory, U 
undirected edges yield a set of Msnt — U — N -\- 1 
fundamental cycles. If the system exhibits only unidi- 
rectional edges, Mb — Msnt- In the other limiting case 
dynamical reversibility holds and Mb — Msnt = U. The 
U additional numbers can be thought of as the detailed 
balance, i.e., diffusive, part of the U bidirectional tran- 
sitions. Further, one can (by using the freedom of choice 
in the enumeration) specify a set of disjoint cycles to 
be part of the decomposition. A possible choice is to 
include the set of 2-cycles (of which there are t/ in a dy- 
namically reversible system). The result is a splitting of 
the fluxes in a detailed-balance part (the set represented 
by the 2-cycles), and the remaining current part. This 
resembles the approach in [3], but is conceptionally dif- 
ferent because the decomposition here does not discard 
the information stored in the 2-cycles. 



VI. DETAILED BALANCE DYNAMICS ON 
CYCLE SPACE 

The set of weights {to*^ } can be interpreted as a map- 
ping that transforms the original graph G = (V, E) into a 
new one H — {C, Ec), see figure [2] For instance, the ver- 
tex a G C represents the cycle a in G with the non-zero 
weight TO* as identified by the algorithm. A directed edge 
(a, /3) G Ec indicates that two cycles share at least one 
vertex of G, i.e., one state of the original system. Each 
edge (a, /3) of the transformed graph is associated with a 
transition rate 6^ . In the analogy of the mass transit sys- 
tem V'^ := TO* 6^ characterizes the number of passengers 
changing from line a to line /3 in the stationary system. 

We shall call the operation G H the cycle trans- 
form. By virtue of ( [T2| the steady-state fluxes can be 
calculated from {to* } and {x^}- If the steady-state dis- 
tribution {p*} is known, the full Markovian dynamics on 
the original state space can be reconstructed. In terms 
of cycles, the {p* } can be interpreted as loops associated 
with each vertex in G [cj. the discussion of the discrete 
case below). 

To find the rate constants &^ we realize that in the 
steady state at each vertex Vi {i.e., station, in the socio- 
physical picture) a constant number of passengers arrives 
per unit time. This number is proportional to the over- 



all influx Xj,7"^^ — J2j^i 't'l ■ The passengers carry 
tickets indicating which line they are running on. Upon 
arrival at the station, a passenger enters his ticket into 
a ticket machine that provides him with a new one. The 
probability to draw a ticket for line (3 is given by ratio 



5 




of the weight of hne (3 to the weights of all lines serving 
station i, i.e., 



'0 



(19) 



The total flux -0" from line a to line /3 is obtained by 

summing the local exchange flux m'^b^^'^ over all mutual 
stations where Xi,i3Xi,a = 1 



\ ^ Xi..l3Xi.a 



-a ^ 



Xi,7^ 



(20) 

A remarkable feature of this new formulation is that 
the cycle-space fluxes fulfill detailed balance = 
for all a,/3). In the steady state this is a microscop- 
ically balanced ticket exchange. It means, that on aver- 
age, passengers arriving at a station just exchange tickets 
with other passengers, and board the line for which their 
new ticket holds. 

Because of detailed balance in H we can proceed along 
the line indicated by ([8| . Replacing by , one obtains 
a potential "Hq, such tnat the occupation numbers m* are 
given by Boltzmann weights. 



Z ^exp(— 'Hq). 



(21) 



of the invariant measure p* , the steady-state fluxes 
have to be known. From an analytical point of view this 
requires the full solution of the mathematical problem. 
However, in experiments fluxes might be easier accessible 
than probabilities. 



VII. AVERAGES ON CYCLE SPACE 

For every well-defined mapping F : a ^ Fa from the 
set of cycles to the real numbers we define the cycle av- 
erage 



(23) 



For instance, for the characteristic functions a have 

On the other hand, (l)c 7^ 
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uxes are not normalized weights. 



(Xj-)c = 0j by eqs. 
1, because the edge f 

Now let us consider cycle-space observables related to 
physical quantities. Consider some matrix F G 'WJ^'^^ . 
We can interpret this quantity as the change of some 
physical observable due to the transitions between differ- 
ent states. We define 



(24) 



Here the partition function 



Z = ^ Tq exp (-"Ho 



(22) 



includes the average cycle period = Xi,a{Ti). After 
all, the weights to* are not probabilities. According to 
equations ^ and ([l2]) they rather fulfill 



In summary, the potential Ha is obtained from the NESS 



as the average fiux of quantity F at time t. The last 
equivalence is the definition of the average as the two- 
point probability-density function (propagator) at time 
t. For antisymmetric F one has Jp = 1/2 ^ FjF!-. 

To connect this with the cycle transform we define an 
observable 



(25) 



which is the integrated contribution of F along cycle a. 
With the linearity of the averages 



fluxes by determining the population density m* of Jp — lim (F)2,t = ^^j*?^}* = ^*aX).aF} 



the cycles, followed by equations (191, (20) and finally 



(|8|). Though our approach does not require knowledge 



{F)c. 
(26) 
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state 


configuration 


state 


configur at ion 


1 


• 0.0 


2 


0..0 


3 


• 00. 


4 


••00 


5 


00.. 


6 


0»0» 



TABLE I. The six possible configurations for tlie TASEP ex- 
ample. The corresponding network of states is shown in fig- 
ure [3] Transitions 5—^1 and 6—^4 involve a particle leaving 
at the right site and entering at the left site. 



VIII. DYNAMICAL REVERSIBILITY AND 
NON-EQUILIBRIUM THERMODYNAMICS 

Here we provide the connection of averages in the gen- 
eral formahsm to the ones needed to describe physical 
currents in non-equilibrium systems. To that end we 
consider dynamically reversible systems, ([t]). This is no 
constraint because in physical systems one has reversible 
microscopic laws. This means that for every microscopic 
"forward" trajectory leading the system from state i to 
j also the time-reversed "backward" trajectory from j to 
i is a solution of the equations of motion. Remember 
that this is not needed for the application of the cycle 
transform, as the example of figure [T] shows. 

Dynamical reversibility allows the connection of 
Markov process to (non-equilibrium) thermodynamics 
[in HH [TB]. The central quantities describing a NESS 
are the non-zero macroscopic currents / which are driven 
by macroscopic affinities A. One can consistently define 
them also on the level of stochastic transitions: 



(27a) 



A) := log 



-log,^^ (27b) 

Further, a connection with entropy production and there- 
fore heat dissipation can be made (c/. also the analogies 
given infAl). Observe that sgn(/j) = sgn(^*). Conse- 
quently, me positive total entropy production can always 
be expressed [2] as 



(28) 



Cycle affinities are the integrated values (251 of the anti- 
symmetric affinity matrix Aj. They are related to the 
macroscopic thermodynamic affinities as was first real- 
ized by Hill and formulated somewhat differently by 
Schnakenberg 0. With the decompositions introduced 
above one generalizes the results of Schnakenberg [2] and 
the Quians [TU] 



p* 



T* 



{A) 



c 



(29) 



for the entropy production in the steady state to cycles 
obtained by the deterministic algorithm presented above. 
In the context of entropy production cycles are also used 
[SHTO] for the well-known fluctuation relations for the en- 
tropy production along (a set of) individual random tra- 
jectories (c/. [niiig). 



cycle 


sequence 


gait 


graph 


a 

/3 

7 
5 


•&»0^»00»^0»0»^»»00 (1 ^ 3 ^ 6 ^ 4) 
• 0^0^0^^0^0^0^^^^00 (1 2 ^ 6 ^ 4) 


If 
lb 
2f 
2b 


€> 

<^ 



TABLE II. The four different cycles of the TASEP example. 
Each cycle corresponds to a different "gait" of the two parti- 
cles. Gaits are characterized by step size (1 or 2) and whether 
the front or back particle moves first (f or b). 



IX. CHANGE OF DOMINANT PATHS: 
2-PARTICLE 4-SITE DRIVEN TASEP 

In this section we illustrate the consequences of a pa- 
rameter change on the selection of paths in a variant of 
a totally asymmetric exclusion process (TASEP), |I9) . 
Consider a one-dimensional periodic lattice {i.e., a ring) 
with four sites. On the lattice we put two particles and 
allow them to move in only one direction. |20j Each site 
can only be occupied by one particle so the particles are 
not independent of each other. The rates for particles 
jumping from one site to the next are all equal (and set 
to unity) but one, which is set to a value a; > 0. Par- 
ticles are accelerated or slowed down at that site. The 
system's state is represented by binary 4-tupels with "•" 
representing an occupied and "0" an empty site, see ta- 
ble |lj Figure [sj^a) shows the network of states with its 
positive transition rates. The rate for a particle jumping 
over the edge from the last to the first site has magnitude 
X. This corresponds to transitions 5 — > 1 and 6 ^ 4, as 
they are the ones utilizing the periodic boundary condi- 
tions, cf. table |l] 

The steady-state distribution is 

p = [x{l + x),x{l + x), x{l + x), 2x^ 2, 2x) /C{x), 
C{x) ^2 + hx + bx^ 



leading to the steady-state fluxes 

cfl^ 4>l^ <t>\^ cj)l = {x/C{x)){l + x), 
<Pt^(bt^ ix/C{x)) 2x, 
4^ft^{x/C{x))2. 



(30) 



For x — 2 the fluxes are the ones of the initial example 
(figure [l]) up to a factor of 2/C(2) = ^. 

We now take a closer look at the four cycles present in 
the system. The cycles correspond to four different gaits 
of the particles characterized by the step size and whether 
the front or back particle particle moves first. The dis- 
tinction between front and back is arbitrary, due to the 
periodicity of the system. Particles cannot overtake, so 
one can distinguish particles. In this case, completing 
any of the cycles leads to a state that has the particles 
switched. Completing two cycles would then bring the 



FIG. 3. The network of states for the TASEP example. The rates shown in (a) lead to the steady state shown in (b). For x = 2 
the fluxes are proportional to the ones shown in the original example, figure [T] (a) Transition rates of the TASEP example 
with a variable jump rate x for transitions involving a particle jump over the boundary, (b) Dependence of the steady-state 
fluxes on x. For clarity, the edge fluxes shown are divided by the common factor x/C{x), cf. (30 1. 



region 


fluxes 


decompositions 


X > 1 


2 <l + x <2x 


{x + l)a + {x-l)d + 2/3, 
{x + 1)S + {x - l)a + 2'f 


x = l 


2 = l + x = 2x 


2a + 2/3, 27 + 26 


X <1 


2> l + x>2x 


{x + l)l3 + {1 - x)j + 2xa, 
(x + l)j+{l-x)^ + 2xS 



TABLE III. Different decompositions depending on x. A tran- 
sition happens at a; = 1. The numerical values shown are the 
weights divided by the common factor xjCix). 



system to its original configuration. The full characteri- 
zation is shown in table |TT1 

One can easily check that the algorithm given in sec- 
tion |III| leads to only two possible decompositions for 
any positive x. As said above, which of those two de- 
compositions is realized depends on the ordering of cy- 
cles. Further one can see that there are three regions for 
X corresponding to qualitatively different decompositions 
(see table III I . For a; > 1 we always end up with non-zero 
weights for one of the decompositions shown in figure [l] 
which are {a,7, i5} or {a,/3, 5}. For < x < 1 we have 
a qualitatively different behavior as the decomposition 
will either feature {a, /3,7} or {/?,7,(5}. At the transi- 
tion point X = \ the possible decompositions, {a, /?} or 
{7,5}, consist of two cycles. 

We now look at the number of cycles needed for the 
decomposition and compare it to the cycles used in other 
theories. The Betti number for this system is Mb — 
8 — 6-1-1 = 3. It agrees with the number of fundamental 
cycles used in SNT, Msnt = Mb, because we have only 
uni-directional transitions. In the highly symmetric case 
X ~ I our algorithm yields a smaller number of cycles, 
2 < 3 



AIb- Table III summarizes the decompositions 
and numerical values of the weights in the three regions. 

The crucial point is that the decomposition structure 
changes at the transition point a; = 1, meaning that some 
zero-weights suddenly become positive while other go to 
zero. We can also note this by only looking at one cy- 



cle, which we fix to be the first one to be considered by 
the algorithm, i.e., a\ . By that, its appearance in the 
decomposition is ensured. Then, at the transition point 
X = 1 we observe a discontinuous change in the derivative 
AvTLa^jAx of its weight from 1 to 2. 

These discontinuous changes in the structure of cycles 
and their weights are related to a change in the dominant 
paths in the network of states. In our example, this is 
triggered by the change from accelerating to decelerating 
a particle when it crosses the periodic boundary. 

The ASEP with a modified transition (or bond) rate 
on a periodic one-dimensional lattice has been introduced 
in [21] , where it was observed that a fast bond leads only 
to local correlations, whereas a slow bond can have long 
range effects (due to particles piling up). An exact for- 
mula for the stationary measure of the slow bond system 
remains an open problem, and it would be interesting to 
investigate possible connections with the changes in cycle 
structures. 



X. CONCLUSION AND OUTLOOK 

In this work we presented a mapping, the cycle trans- 
form, that generally applies to steady states of Markov 
processes on a finite state space. It can be used to trans- 
form a non-equilibrium steady state represented by a 
graph G into an equilibrium steady state on a graph H 
whose vertices are appropriately chosen cycles in G. 

The presented mapping is obtained by using a deter- 
ministic algorithm rather than a stochastic algorithm 
iZj ilfij • Therefore the theory lies between theories based 
on all possible flux cycles (c/. Hill's theory, [TT]) and the- 
ories using fundamental current cycles (c/. SNT, [3[H]). 
The non-uniqueness of our decomposition can be used to 
separate detailed balance contributions (2-cycles) from 
non-equilibrium currents (non-trivial cycles). 

Further, the connection between averages defined on 
the space of cycles to steady-state averages was made. 
For physical systems, a natural symmetry on G, called 
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symbol 


analoev 


thermodynamic 


electric 




— log Pi 


potential 




^"6 IPt/ Pj\ 


total differential 


voltage 


P 




current 


^3 




affinity, gross FED 




'-'3 




haste FED 


3lectromotance 


R) 


mm 




resistance 


p 

sys 




system entropy change 


power 



TABLE IV. Electric and thermodynamic analogies. FED de- 
notes free energy differences as in Hill's theory, (11) . 



dynamical reversibility, allovifs us to relate the method to 
currents in non-equilibrium thermodynamics. 

The suggested approach also has interesting parallels 
to the theory of dynamical systems, especially chaos the- 
ory [TU','^. In chaos theory cycles, i.e., unstable periodic 
orbits of the dynamical system, play a crucial role. They 
lie dense in phase space such that trajectories can be seen 
as a realization of a random-walk dynamics between cy- 
cles, similar to the dynamics in cycle space considered in 
the present study. Expectation values in such systems 
can also be calculated using cycle expansions. 

Finally, we illustrated the method by exploring a 
TASEP example where one can interpret the cycles as 
different periodic gaits. It exhibits a crossover of the 
preferred paths in response to a parameter change. This 
is reflected in a discontinuous change of weights of the 
cycles. In addition, there is a topological change: At the 
transition point, the structure of the cycle decomposition 
changes. 

In forthcoming work, the cycle transform might serve 
as another perspective on thermodynamic machines 
where different cycles represent the different operation 
modes. A well-studied example is the steady-state dy- 
namics of the molecular motor kinesin [23) . For such 
small machines thermal fluctuations play a crucial role. 
The cycle-transform representation of the entropy pro- 
duction, eq. (29), is an important perspective to this 
problem. Cycle affinities and cycle currents can be used 
to formulate fluctuation relations [H IH [T7] . 
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in the literature that are suitable for different purposes 
(see e.g. [Sll^). Hill also noticed the connection of the 
logarithmic ratios of fluxes and transition rates with dif- 
ferences of free energies |TT] . The appropriate analogies 
are summarized in table IV In this analogy the quanti- 



ties defined above have the properties of their electrical 
counterparts: 

U , /, A and £ are asymmetric and the resistance R is 
symmetric and positive. The definition of the fluxes, ([2|, 
obeys Kirchhoff's equation [12], 



c'l n 

" ^3 ~ ^'J^V 



(Al) 



which states that if no current is flowing between two 
nodes with a battery-like element connecting them, a 
voltage difference U is created. This voltage is the nega- 
tive of the electromotance £ of the battery. However, if 
a current is running over a resistor i?, it obeys an Ohmic 
law and the voltage drops by i? • /. Kirchhoff's current 
law ("node rule") amounts to Q. Kirchhoff's voltage 
law ( "mesh rule" ) states that integrating the voltage dif- 
ferences around a closed cycle is zero. This also holds 
in our analogy. It is the basis for the identification of U 
with a total differential in thermodynamics. 

Finally, the quantity Psys describes the change of the 
system's Gibbs entropy Ssys '■= — J2iPi log Pi the sys- 
tems undergoes its dynamics, 



P. 



(A2) 



It vanishes in the steady state, and can be related to 
the irreversible entropy production Ptot by defining an 
entropy flux to the medium [2, 3 



-E 

2 ^ 

1:3 



log 



(A3) 



One then flnds Ptot = Psys + Pmed- Introducing thermo- 



dynamic analogues one obtains Pmed = 5 S 
that Ptot = 5 X)i 7 ^{Uj + ^])- Hence, the deflnitions of 



™ch 



table IV are consistent with the deflnitions made earlier. 



and Aj 



The analogy is not perfect, however. Consider a sim- 
ple cycle with the same current flowing through all nodes. 
Then the potential difference between two non-adjacent 
nodes i and j cannot be obtained from an effective resis- 
tance (or electromotance) which is the sum of the indi- 
vidual resistances (or elect romotances) of the edges con- 
necting i to i as it would be the case in an electrical 
network. 



Appendix A: An electric and thermodynamic 
analogy 

In this section we introduce an analogy relating 
Markov processes, thermodynamics and electrical cir- 
cuits. Different electric analogies have been presented 



Appendix B: Discrete case 

If time is measured in discrete units r one obtains a 
Markov chain. In that case one has transition probabili- 
ties < a* < 1 rather than transition rates w^ . Instead 
of a waiting time one has a staying probability a\ 7^ 0. 
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The transition matrix is (A)* = a* and the evolution of 
the probabihty distribution pi obeys 



i 



(Bl) 



With the normahzation for the transition probabiHties 
E«5 = l (B2) 



and defining discrete time fluxes (i.e ., joint probabihties) 
4>j{t) = Pi{t)(i] one can rewrite (Bf ) into a master equa- 
tion 



(B3) 



The steady-state condition is formally identical to Q. 
Therefore, all relations for the cycle representation also 
hold in the discrete case. 

Further, the analogies presented in table |IV| hold if one 
substitutes the transition rates Wj for the jump proba- 
bilities Oj . Still, there is a subtle difference we would like 
to point out: 

The cycle transform introduced above only uses fluxes 
(/)^ with i ^ j. Therefore, the number of variables to be 
specified is N{N — 1). In the discrete case, it is straight- 
forward to include the disjoint loop fluxes into the cy- 
cle transform by specifying N additional variables. One 
can then uniquely reconstruct the transition matrix A 
and the steady state probabilities p* from the fiuxes by 
using (Bl) and the definition of the fluxes. As in the 



continuous-time case, to reconstruct the full steady state 
one has to specify N additional variables that do not 
directly influence the cycle transform algorithm. 
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